On Measures of Information and Divergence and Model Selection Criteria
نویسندگان
چکیده
1: In this paper we discuss measures of information and divergence and model selection criteria. Three classes of measures, Fisher-type, divergencetype and entropy-type measures, are discussed and their properties are presented. Information through censoring and truncation is presented and model selection criteria are investigated including the Akaike Information Criterion (AIC) and the Divergence Information Criterion (DIC).
منابع مشابه
Multi-criteria IT personnel selection on intuitionistic fuzzy information measures and ARAS methodology
Global challenge and the speedy growth of information technologies compel organizations to constantly change their ways. At the present time, associations need IT personnel who create a difference by creative thoughts and who preserve with the rapid amendments. Since the evaluation of IT personnel selection (ITPS) consists of different alternatives and criteria, therefore, IT personnel selectio...
متن کاملInformation Measures via Copula Functions
In applications of differential geometry to problems of parametric inference, the notion of divergence is often used to measure the separation between two parametric densities. Among them, in this paper, we will verify measures such as Kullback-Leibler information, J-divergence, Hellinger distance, -Divergence, … and so on. Properties and results related to distance between probability d...
متن کاملFeature Selection Using Multi Objective Genetic Algorithm with Support Vector Machine
Different approaches have been proposed for feature selection to obtain suitable features subset among all features. These methods search feature space for feature subsets which satisfies some criteria or optimizes several objective functions. The objective functions are divided into two main groups: filter and wrapper methods. In filter methods, features subsets are selected due to some measu...
متن کاملGeneralized Measures of Divergence for Lifetime Distributions
Measures of divergence or discrepancy are used either to measure mutual information concerning two variables or to construct model selection criteria. In this paper we are focusing on divergence measures that are based on a class of measures known as Csiszar’s divergence measures. In particular, we propose a measure of divergence between residual lives of two items that have both survived up to...
متن کاملCriteria for Linear Model
Model selection criteria frequently arise from constructing estimators of discrepancy measures used to assess the disparity between thètrue' model and a tted approximating model. The Akaike (1973) information criterion and its variants result from utilizing Kullback's (1968) directed divergence as the targeted discrepancy. The directed divergence is an asym-metric measure of separation between ...
متن کامل